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Abstract — We consider transmission over a wiretap channel 
where both the main channel and the wiretapper's channel are 
Binary Erasure Channels (BEC). We propose a code construction 
method using two edge type Low-Density Parity-Check (LDPC) 
codes based on the coset encoding scheme. Using a standard 
LDPC ensemble with a given threshold over the BEC, we give a 
construction for a two edge type LDPC ensemble with the same 
threshold. If the given standard LDPC ensemble has degree two 
variable nodes, our construction gives rise to degree one variable 
nodes in the code used over the main channel. This results in 
zero threshold over the main channel. In order to circumvent 
this problem, we numerically optimize the degree distribution of 
the two edge type LDPC ensemble. We find that the resulting 
ensembles are able to perform close to the boundary of the rate- 
equivocation region of the wiretap channel. 

There are two performance criteria for a coding scheme used 
over a wiretap channel: reliability and secrecy. The reliabil- 
ity measure corresponds to the probability of decoding error 
for the intended receiver. This can be easily measured using 
density evolution recursion. However, it is more challenging to 
characterize secrecy, corresponding to the equivocation of the 
message for the wiretapper. Measson, Montanari, and Urbanke 
have shown how the equivocation can be measured for a broad 
range of standard LDPC ensembles for transmission over the 
BEC under the point-to-point setup. By generalizing the method 
of Measson, Montanari, and Urbanke to two edge type LDPC 
ensembles, we show how the equivocation for the wiretapper 
can be computed. We find that relatively simple constructions 
give very good secrecy performance and are close to the secrecy 
capacity. However finding explicit sequences of two edge type 
LDPC ensembles which achieve secrecy capacity is a more 
difficult problem. We pose it as an interesting open problem. 



I. Introduction 

Wyner introduced the notion of a wiretap channel in [3) 
which is depicted in Figure Q] In general, the channel from 
Alice to Bob and the channel from Alice to Eve can be 
any discrete memoryless channels. In this paper we will 
restrict ourselves to the setting where both channels are Binary 
Erasure Channels (BEC). We denote a BEC with erasure prob- 
ability e by BEC(e). In a wiretap channel, Alice communicates 
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a message S_, which is chosen uniformly at random from the 
message set S, to Bob through the main channel which is a 
BEC(e m ). Alice performs this task by encoding S as an n bit 
vector X_ and transmitting X_ across BEC(e m ). Bob receives 
a noisy version of X_ which is denoted by Y_. Eve observes 
X via the wiretapper's channel BEC(e,«) and receives a noisy 
version of X_ denoted by Z_. We denote such a wiretap channel 
by BEC-WT(e ro , e w ). 
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Fig. 1. A BEC wiretap channel. 

The encoding of a message S_ by Alice should be such 
that Bob is able to decode S_ reliably and Z_ provides as little 
information as possible to Eve about S_. 

A detailed information theoretic overview of general wiretap 
channels can be found in J4J. In 0, (6) the authors have 
given code design criteria using sparse graph codes. Their 
approach is based on a coset coding scheme using nested codes 
0. In (8) the authors have suggested a coding scheme for 
the BEC-WT that guarantees strong secrecy for a noiseless 
main channel and some range of e w using duals of sparse 
graph codes. In (9l it was shown that random linear codes can 
achieve the secrecy capacity over the binary symmetric wiretap 
channel and an upper bound on the information leakage was 
derived. Recently it has been shown that using Arikan's polar 
codes [ 10 1, it is possible to achieve the whole rate-equivocation 
region HD, (H], O, 01. 

We propose a code construction method using two edge 
type LDPC codes based on the coset encoding scheme. The 
threshold of a code (or an ensemble) for transmission over 
the BEC is the largest erasure probability for which reliable 
communication is possible. Using a standard LDPC ensemble 
with a given threshold over the BEC, we give a construction 
for a two edge type LDPC ensemble with the same threshold. 
Thus if the standard LDPC ensemble is capacity achieving 
over the wiretapper's channel, our construction of the two 
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edge type LDPC ensemble guarantees perfect secrecy. Hence 
it achieves secrecy capacity if e m = i.e. the main channel 
is noiseless. 

However, our construction cannot guarantee reliability over 
the main channel if e m > and the given standard LDPC 
ensemble has degree two variable nodes. This is because our 
approach gives rise to degree one variable nodes in the code 
used over the main channel. This results in zero threshold 
over the main channel. In order to circumvent this problem, 
we numerically optimize the degree distribution of the two 
edge type LDPC ensemble. We find that the resulting codes 
approach the rate-equivocation region of the wiretap channel. 
For example, for the BEC-WT(0.5, 0.6) we find ensembles that 
achieve the points (R a b,R e ) = (0.0999064,0.0989137) and 
(R ah ,R e ) = (0.498836,0.0989137) which are very close to 
the best achievable points B = (0.1,0.1) and C = (0.5,0.1) 
as depicted in Figure [2] The definitions of R a b, R e , and a 
description of Figure [2] are given in Section [TTJ 

Note that reliability, which corresponds to the probability 
of decoding error for the intended receiver, can be easily 
measured using density evolution recursion. However secrecy, 
which is given by the equivocation of the message conditioned 
on the wiretapper's observation, can not be easily calculated. 
Measson, Montanari, and Urbanke have derived a method to 
measure equivocation for a broad range of standard LDPC 
ensembles for point-to-point transmission over the BEC (151 . 
From now onwards we call it the MMU methocQ. The MMU 
method was extended to non-binary LDPC codes for transmis- 
sion over the BEC in (16), (17) ■ By generalizing the MMU 
method for two edge type LDPC ensembles, we show how 
the equivocation for the wiretapper can be computed. We find 
that relatively simple constructions give very good secrecy 
performance and are close to the secrecy capacity. 

Our paper is organized in the following way. In Section 
im we give various definitions, describe the coset encoding 
method and two edge type LDPC ensembles, and give the 
density evolution recursion for two edge type LDPC ensem- 
bles. Section [Til] contains the code design and optimization 
for the BEC wiretap channel BEC-WT(e m , e w ). In Section 
IIV1 we show that the task of computing the equivocation is 
equivalent to generalizing the MMU method for two edge type 
LDPC ensemble for point-to-point transmission over the BEC. 
We generalize the MMU method for two edge type LDPC 
ensemble in Section [V] In Section [VI] we present various 
examples to elucidate the computation of equivocation and 
show that our optimized degree distributions also approach the 
information theoretic equivocation limit. Finally, we conclude 
in IVIII with some discussion and open problems. 

II. Code Construction 

We first define a code for the wiretap channel. 

Definition 1 (Code for Wiretap Channel). A code of rate R a b 
with block length n for the wiretap channel is given by a 
message set S of cardinality \S\ = 2 nRab , and a set of disjoint 

1 We call it the MMU method in acknowledgment of Measson, Montanari, 
and Urbanke, the authors of 1151 . 



sub-codes {C(s) C X n } s eS- messages. To encode the message 
sdzS, Alice chooses one of the codewords in C(s) uniformly 
at random and transmits it. Bob uses a decoder (f> : y n — > S 
to determine which message was sent. 

We now define the achievability of rate of communication 
from Alice to Bob and equivocation of the message from Alice 
to Bob for Eve. 

Definition 2 (Achievability of Rate-Equivocation). A rate- 
equivocation pair (R a b, Re) is said to be achievable if Ve > 0, 
there exists a sequence of codes of rate R ao of length n and 
decoders <j) n such that the following reliability and secrecy 
criteria are satisfied. 

Reliability: lim P(<t> n (X) ^ S) < e, (1) 
Secrecy: lim inf -H(S\Z) > R e - e. (2) 

n— >oo Ji 

Note that we use the weak notion of secrecy as opposed to 
the strong notion (4) . With a slight abuse of terminology, when 
we say equivocation we mean the normalized equivocation 
as defined in the LHS of (fJJ. From the achievable rate- 
equivocation region for general wiretap channels given in 0, 
the set of achievable pairs (R a b, Re) for the BEC-WT(e m , e w ) 
is given by 

Re < Rab < 1 — £mi < R e < C w — e m . (3) 

The rate region described by (0) is depicted in Figure [2] 
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Fig. 2. Achievable rate equivocation region for BEC-WT(e m , e w ). 

The line segment AB in Figure [2] corresponds to to perfect 
secrecy. 

Definition 3 (Perfect Secrecy and Secrecy Capacity [3]). The 
points in the achievable region where R a b — Re correspond 
to perfect secrecy i.e. for these points I(Z_]S_)/n — > 0. The 
highest achievable rate R a b at which we can achieve perfect 
secrecy is called the secrecy capacity and we denote it by Cs- 

For the BEC-WT^, e m ), we have Cs = e w — £m- We now 
describe the coset encoding and syndrome decoding method. 
Let H be an n(l — R) x n LDPC matrix. Let C be the code 
whose parity-check matrix is H. Let Hi and H2 be the sub- 
matrices of H such that 



where Hi is an 71 (1 — Ri) x n matrix. Clearly, Ri > R. Let 
Ci be the code with parity-check matrix Hi. C is the coarse 
code and Ci is the fine code in the nested code (Ci,C) Q. 
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Also, C\ is partitioned into 2"(- Rl_fl ) disjoint subsets given 
by the cosets of C. Alice uses the coset encoding method to 
communicate her message to Bob which we now describe. 

Definition 4 (Coset Encoding Method). Assume that Alice 
wants to transmit a message whose binary representation is 
given by an n(R\ — R)-bit vector S. To do this she performs 
coset encoding by transmitting X, which is a randomly chosen 
solution of 



perspective respectively. Note that only one type of edges is 

( i ) (i) 

connected to a particular check node. Tr and p r ' are related 
as follows, 



Hi 

H 2 



A = [0 ■ • ■ Sf J 



Bob uses the following syndrome decoding to retrieve the 
message from Alice. 

Definition 5 (Syndrome Decoding). After observing Y_, Bob 
obtains an estimate X_for X_ using the parity check equations 
H\X_ = 0. Then he computes an estimate S_ for S_ as S_ = 
HyX, where S_ is the syndrome of X_ with respect to the matrix 
H 2 . 

A natural candidate for coset encoding is a two edge type 
LDPC code lfl~8"l . A two edge type matrix H has form 



H 



Hi 
H 2 



(4) 



The two types of edges are the edges connected to check nodes 
in H\ and those connected to check nodes in H 2 . An example 
of a two edge type LDPC code is shown in Figure [3] 
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Fig. 3. Two edge type LDPC code. 
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We now define the degree distribution of a two edge type 
LDPC ensemble. Let Aj j denote the fraction of type j (j = 1 
or 2) edges connected to variable nodes with li outgoing type 
one edges and l 2 outgoing type two edges. The fraction Ap ] 
is calculated with respect to the total number of type j edges. 
Let A[ ± i 2 be the fraction of variable nodes with li outgoing 
edges of type one and l 2 outgoing edges of type two. This 
gives the following relationships between A, A' 1 ', and A^ 2 ', 



v(2) 
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(6) 
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Similarly, let p r and T r denote the degree distribution of 
type j edges on the check node side from the edge and node 
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(8) 
(9) 



An equivalent definition of the degree distribution is given 
by the following polynomials: 



A«(^) = £A«^-V*, 

r«(x) = ^r«^, j = 1,2, 

r 



(10) 

(11) 

(12) 
(13) 



,>")(*) = ^ p^V- 1 , i = 1,2. (14) 



Like the standard LDPC ensemble of fl9l , the two edge 
type LDPC ensemble with block length n and degree dis- 
tribution {A^^A^),^ 1 ),^ 2 '} ({A^f 1 )^^)} from node 
perspective) is the collection of all bipartite graphs satisfying 
the degree distribution constraints, where we allow multiple 
edges between two nodes. We will denote a left regular two 
edge type LDPC ensemble for which A(x, y) = x ll y l2 by 

{M 2 ,r«r( 2 )}. 

Consider the two edge type LDPC ensemble {A, T (2) }. 
If we consider the ensemble of the subgraph induced by 
one particular type of edges then it is easy to see that the 
resulting ensemble is the standard LDPC ensemble and we 
can easily calculate its degree distribution. Let {A^T^} 
be the degree distribution from node perspective ({X^\ p^} 
from edge perspective) of the ensemble induced by type j 
edges, j — 1,2. Then A^\ for j = 1, 2, is given by 



(15) 



h h 
The corresponding polynomials are defined as 

i i 

To illustrate the relationship between various degree distri- 
butions, we consider a two edge type LDPC ensemble with 
degree distribution 

A(x, y) = 0.2xV + 0.4a;V + 0Ax 6 y 6 , 
r (1) (» =0.6x 7 + 0.4x 8 , 
r( 2 )(a;) =x 10 . 
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Using 0, ©, Q, ©, ©, and JBT ). we obtain 



a (x,y) 


— 1 t 2 ,A 

— —x v - 

7 y 


2 , r 4 r R 

1- -jX y + -x y , 




= 


5 6 
H x 3 w 4 H x 6 w 5 


pW{x) 


21 6 


16 7 


= 37* + 


37 X ' 


P [2 \x) 


= x, 




A«(x) 


= 0.6x 3 + 


0.4x 6 , 


A^(x) 


= 0.2x 4 + 


0.4x 5 + 0.4x 6 . 



We now derive the density evolution equations for two edge 
type LDPC ensembles, assuming that transmission takes place 
over the BEC(e). Let x^ denote the probability that a message 
from a variable node to a check node on an edge of type j in 
iteration I is erased. Clearly, 



e, J = 1,2. 



(17) 



In the same way let y}- ' be the probability that a message 
from a check node to a variable node on an edge of type j in 
iteration I is erased. This probability is 



(i) 



1- p^{l-xf), j = l,2 



(0 



(18) 



Using this we can write down the following recursions for 

JJ). 

X 3 ■ 

x« + V=e\M(y[ l \yP) (19) 
x^^eX^(y[ l \yi% (20) 

We denote the binary entropy function by 

h(x) = -xlog 2 (x) - (1 - x)log 2 (l - x). 

The indicator variable Irji corresponding to a statement 5 
is given by 

J 1 if S is True, 
{s} = 1 Otherwise. 
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By coef { FiD 1 , D 3 } we mean the coefficient of in the 
formal power sum FiD 1 , i.e. coef FiD*, Z)- 7 } = Fj. 

In the next section, we show how the degree distribution 
of a two edge type LDPC ensemble can be chosen such that 
it has the same density evolution recursion as that of a given 
standard LDPC ensemble. We also numerically optimize the 
degree distribution of two edge type LDPC ensembles and 
show that we can approach points on the boundary of the 
achievable rate-equivocation region. 

III. Design and Optimization 

As the density evolution recursion is a two dimensional 
recursion for two edge type LDPC ensembles, it is difficult to 
analyze. Thus we look for degree distributions which reduce 
the two dimensional recursion to a single dimension. This will 
enable us to use density evolution recursion for standard LDPC 
ensembles over the BEC, which has been very well studied. 
In the following theorem, we accomplish this task. 



Theorem III.l. Let (A, p) be a standard LDPC degree dis- 
tribution with design rate R and threshold e* over the BEC. 
Then the following assignment, 



p^(x)=p^(x)=p(x), 

_ X (2) 



U+l 21 + 1 

\(1) _ \(2) _ \ + 1 

- A u+i - 21 + 1 



\22 + l, 



^21 + 1, 



(21) 
(22) 

(23) 
(24) 



X hl = X hl = °> |li-fel>l, (25) 

ensures that the two edge type LDPC ensemble 
{A*- 1 ' , \( 2 \ p^\ p^ } also has design rate R and threshold 
e*. 

Proof: Assume that we choose AW, A^ 2 ), p^\ and p^ 
such that ( 1211 and the following relation 



\ {1 \x,x) = \ ( - 2) (x,x) = \(x). 
is satisfied. Note that since 



(26) 



a«(x,x) = ]T^ 

h,l: 




implies 



^ / ^1^2 ^ ; X llh 



(27) 



h+h=k 



From the density evolution recursion for two edge type LDPC 
ensembles given in ( fT7b . ( fl~8b , ( fl"9l >, and (1201 . we see that ( 1211 
ensures that y^ — yij whenever x± — x^ and ( 126*1 ) ensures 



x 2 +1 ' whenever yp = ■ Since Xj 



e, by 



induction we see that = x% and yf* — y%' for I > 1. 
Thus we can reduce the two dimensional density evolution 
recursion to the one dimensional density evolution recursion 
for standard LDPC ensemble 



5C+ 1 ) = eA(l-/>(l-x w )), 



(28) 



where A(x) = £) fe A k- 



„fc-l 



and we have dropped the subscript of a; as xf^ = x 2 \ Note 
that by <f22]), ([23]), (El), and ([25} 



A (l) A (2) 



v/i,z 2 . 



(30) 



This ensures that ((TJl is fulfilled. 

We now show that ( f22l . ( |23l , ( f24l) . and d25l l guarantees that 
A^fx, x) = A^ 2 -*(x, x) = A(x). Then the two dimensional 
density evolution recursion becomes the one dimensional 
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recursion in ((28) and the two type edge ensemble will have 
the same threshold as the standard LDPC ensemble. We have 



(0„2/-l , \(0 21 



( b ) / 1 \ 2/ , \ 2/-1 

2iTT X2l+lX +X2lX 



E l + 1 \ 2/ 
, 2iTi X2l+lX ' 

=A(x), 



The proof 



where (a) is due to ( f23T > and (b) is due to d22l - 
for AC 2 )(a;, a;) is done in the same way. 

We now show that the design rate of the resulting two edge 
type LDPC ensemble is the same as the design rate of the 
given standard LDPC ensemble. The design rate of the two 
edge type ensemble is 



1 — (mi + m%)jn 



where rrij is the number of parity checks of type j and n is 
the number of variable nodes. If we let d avg denote the average 
check node degree (same for both the types because of (fJTJ) 
and count the number of type j edges in two different ways, 
we get 

n E l 3^hl2 = ™>jdmg, j = 1,2. 



or 



<avg 



.0) 



(a) 



1 Z^h,i 2 h u 



J-avg 



h,h I) 
(b) 1 1 
f^avg 



h U 



where (a) is due to (O and (b) follows since the A^j* sum to 
1. The design rate then becomes 

-Rdes = 1 - {mi + m 2 )/n, 



1 



1 



1 



h h 



h h 



(a) 



il 



'avg 



h h 



! V 2Z+1 



2i + l 



1 



21 + 1 



= 1 - 



^avg , 

b l^l \ 21+1 

1 1 



A 3 



2( 



where (a) is due to (130b and (b) follows using d22l - (f25b . 
Since this expression is the same as the design rate of the 
standard LDPC ensemble (A, p), we have shown that the two 
edge type LDPC ensemble has design rate R. This completes 
the proof of the theorem. ■ 

To compute the threshold achievable on the main channel, 
we need to compute the threshold of the ensemble of parity- 
check matrices Hi corresponding to type one edges. The 
ensemble of matrices Hi is a standard LDPC ensemble and 
its degree distribution can be easily calculated from the degree 
distribution of the two edge type ensemble. Hence we can 
easily compute its threshold. 

Since all capacity approaching sequences of degree distribu- 
tions have some degree two variable nodes, because of (1221 we 
see that our construction will have some degree one variable 
nodes in the matrix Hi. This means that the threshold over 
the main channel will be zero. To get around this problem 
we use linear programming methods to find good degree 
distributions for two edge type LDPC ensembles based on 
their two dimensional density evolution recursion. 

First we optimize the degree distribution of Hi for the main 
channel using the methods described in |20| and obtain a good 
ensemble (ACO,rCO). 

For a given two edge type ensemble we can find the 
corresponding one edge type ensemble for Hi by summing 
over the second index, since the fraction of variable nodes 
with li outgoing type one edges is given by J2i 2 ^hi 2 - To fix 
the degree distribution of Hi we then impose the constraint 



5^A, lIa =a£ ) for all h. 



For successful decoding we further impose the two con- 



straints x 

as 



(i+0 



< x\' and x 



G+0 



< x$ which can be written 



xi >e\^(yi,y 2 ) 

f V A (1) i, 11 - 1 !, 12 



k-2 



where we have used © in the last step, and yi , yi are given 
by 

Vj = 1- Pj(l - Xj),j = 1,2. 
This simplifies to the linear constraint 

O^Y^hixi-ey^y^A^. (31) 

The corresponding constraint for x-i is 

O^E^-q/i^ 1 )^. (32) 
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The design rate can be written as 

Jldes = 1 — — 



where the term —^r 2 '^n' 2 is a constant because of the 

fixed degree distribution of Hi. If r' 2 ) is fixed we see 
that maximizing the design rate is the same as minimizing 
Ei i 2 h-^-hh- Thus we end up with the following linear 
program, which we will solve iteratively: 



(2) 



minimize 



subject to 

5> W2 =A« h=2,...,I 



(33) 



(34) 



h(xi{k) - eyi(k) h - 1 y 2 (k) h )A hl2 > 0, k = 1, . . . , K 

(35) 

- eyi(k) h y 2 (k) h ~ 1 )A hl2 > 0, k = 1, . . . , K, 

(36) 



h,l 



where I is the largest degree in A^(x). Since the constraints 
(l3TT l and (f32l > correspond to infinitely many constraints we 
replace them by the first K steps of the density evolution 
path followed by the degree distribution used in the previous 
iteration. Thus the points {xi(k), X2(k)}^ =1 are chosen by 
generating a distribution Ao and then running the density 
evolution recursion 



T (i) 



.(*) 



4' +1) =eA^(^, y «), 



(37) 
(38) 
(39) 



if times. The program is then solved repeatedly, each time 
updating {xi(k),X2(k)}^ =1 . This process is repeated several 
times for different check node degree distributions r' 2 ) until 
there is negligible improvement in rate. The complete opti- 
mization procedure is summarized in the following steps. 

1) Find an optimized degree distribution (AW,r«) of 
Hi for the main channel using the methods described 
in ||20l . Fix a check node degree distribution T^ 2 ) 
corresponding to type two edges. 

2) Choose a two edge type variable node degree distribution 
A which satisfies d34i >. 

3) Generate K density evolution points {xi(k), %2(k)}^ =1 
by using ([37), (ED, and <|39). 

4) Solve the linear program given by d33l . (l34l . d35l . and 



5) Repeat Step 3) and Step 4) until there is negligible 
improvement in rate. 
As mentioned before, we repeat the optimization procedure 
for several T^ 2 ). A good choice of r^ 2 ) is either regular or 
with two different degrees. 

We now present some optimized degree distributions ob- 
tained by this method. We use the following degree distribution 



Standard LDPC Degree Distribution 1. 

A (1) (a;) = 0.5572098x 2 + 0.1651436x 3 + 0.07567923a; 4 
+ 0.0571348a; 5 + .043603a; 7 + 0.02679802a; 8 
+ 0.013885518a; 13 + 0.0294308a; 14 + 0.02225301a; 31 
+ 0.00886105a; 100 , 

T (1) (a;) = 0.25a; 9 + 0.75a; 10 

as the ensemble (A^FW) for the main channel. It has rate 
0.498826, threshold 0.5, and multiplicative gap to capacity 
(1 - e - R des ) /(l - e) = 0.00232857. We use it to obtain two 
optimized degree distributions, one for e w = 0.6 and one for 
e w = 0.75. 

The degree distribution for the ensemble optimized for 
BEC-WT(0.5,0.6) is given by 

Two Edge Type Degree Distribution 1. 

A(x, y) = 0.463846a; 2 + 0.0814943a; 2 2/ + 0.0118691a; 2 y 2 
+ 0.14239a; 3 + 0.0201658a; 3 y + 0.00258812x 3 y 2 
+ 0.0292241a; 4 + 0.0464551a; 4 ?/ + 0.0564162a; 5 
+ 0.000718585x 5 y + 0.0436039x 7 y 
+ 0.0258926x 8 y + 0.000905503x 8 y 2 
+ 0.00631474a; 13 y 2 + 0.00757076a; 13 y 5 
+ 0.011051x 14 y + 0.0173718x 14 y 2 
+ 0.00100807a; 14 y 5 -I- 0.00240762a; 31 
+ 0.0012626x 31 y 4 + 0.0185828a; 31 y 5 
+ 0.000326117a; 10 V + 0.00383319a; 100 y 17 
+ 0.00470174a; 100 y 18 , 

T (1) (a;) = 0.25a; 9 + 0.75a; 10 , 

r< 2 >(a;)=a; 6 . 

This ensemble has design rate 0.39893, threshold 0.6, and 
the multiplicative gap to capacity is 0.00267632. The rate 
R a b from Alice to Bob is 0.099906 bits per channel use 
(b.p.c.u.) and R e , the equivocation of Eve, is 0.0989137 
b.p.c.u. However both R a jj is very close to the secrecy capacity 
Cs = 0.1 b.p.c.u., and R e is very close to R a b- 

The degree distribution for the ensemble optimized for 
BEC-WT(0.5,0.75) is given by 

Two Edge Type Degree Distribution 2. 

A(x, y) = 0.367823a; 2 + 0.166244a; 2 y + 0.0231428x 2 y 2 

+ 0.125727a; 3 + 0.0394166a; 3 y + 0.00286773a; 4 
+ 0.0728115a; 4 y + 0.0571348a; 5 y 
+ 0.0300989a; 7 y 2 + 0.013505a;V 
+ 0.0196622a;V + 0.00713582a; 8 y 4 
+ 0.000565918x 13 y 2 + 0.0133196a: 13 y 5 



14„,5 



+ 0.0149732a; i V + 0.0132215a; i4 y 
+ 0.0012361a; 14 y 6 + 0.00490831a; 31 y 8 
+ 0.0173447a; 31 y 9 + 0.00130606x 100 y 17 
+ 0.00498932a; 100 y 30 + 0.00256567a; 10 V 1 , 
rW(i) = 0.25a; 9 + 0.75a; 10 , 
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r( 2 )(a;) = 0.25a; 4 + 0.75x 5 . 

This ensemble has design rate 0.248705 and threshold 0.75. 
The multiplicative gap to capacity is 0.00518359. The rate 
R a b from Alice to Bob is 0.250131 b.p.c.u. and R e , the 
equivocation of Eve, is 0.248837 b.p.c.u. Note that the secrecy 
capacity C s for this channel is 0.25 b.p.c.u. Thus the obtained 
point is slight to the right and below of point B in Figure [2] 

As mentioned earlier, computing the equivocation of Eve 
is not as straightforward as computing the reliability on the 
main channel. In the next section we show how to compute the 
equivocation of Eve by generalizing the methods from |fT31 to 
two edge type LDPC codes. 

IV. Preliminary Results for Computation of 
Equivocation 

In order to compute the average equivocation of Eve over 
the erasure pattern and ensemble of codes, we generalize the 
MMU method of [15| to two edge type LDPC codes. In 
[15 1, the equivocation of standard LDPC ensembles for point- 
to-point communication over BEC(e) was computed. More 
precisely, let X_ be a randomly chosen codeword of a randomly 
chosen code G from the standard LDPC ensemble. Let X_ be 
transmitted over BEC(e) and let Z_ be the channel output. Then 
the MMU method computes 



lim 



e(^g(I|1)) 



(40) 



where Hc(X_\Z_) is the conditional entropy of the transmitted 
codeword given the channel observation for the code G and 
we do the averaging over the ensemble. Note that we need not 
average over the codewords as the analysis can be carried out 
under the assumption that the all-zero codeword is transmitted 
Il20l Chap. 3]. The MMU method is described below. 

1) Consider decoding the all-zero codeword using the peeling 
decoder 1201 pp. 115], which is described in the following. 

a) Initially, remove all the known (not erased from the 
channel) variable nodes and the edges connected to 
them. Now remove all the degree zero check nodes. 

b) Pick a degree one check node. Declare its neighboring 
variable node to be known. Remove all the edges 
connected to this variable node. Remove all the 
degree zero check nodes. 

c) If there are no degree one check nodes, then go to 
the next step. Otherwise, repeat the previous step. 

d) Output the remaining graph which is called the resid- 
ual graph. 

2) The peeling decoder gets stuck in the largest stopping set 
contained in the set of erased variable nodes [20] . Thus the 
residual graph is the subgraph induced by this stopping set. 
The residual graph is again a code whose codewords are 
compatible with the erasure set. 

3) The degree distribution of the residual graph and its edge 
connections are random variables. It was shown in ||2T|| that 
if the erasure probability is above the BP threshold, then 
almost surely the residual graph has a degree distribution 
close to the average residual degree distribution. The 



average residual degree distribution can be computed by 
the asymptotic analysis of the peeling decoder. Also, con- 
ditioned on the degree distribution of the residual graph, 
the induced probability distribution is uniform over all the 
graphs with the given degree distribution. This implies 
that almost surely a residual graph is an element of the 
standard LDPC ensemble with degree distribution equal to 
the average residual degree distribution, which we refer to 
as the residual ensemble. 
4) The normalized expectation of the conditional entropy 
given in (l40l > can be determined from the average rate of 
the residual ensemble. One can easily compute the design 
rate of the residual ensemble from its degree distribution. 
However, the design rate is only a lower bound on the 
average rate. A criterion was derived in [15], which, when 
satisfied, guarantees that the average rate is equal to the 
design rate. If the average rate is equal to the design rate, 
then the normalized expectation of the conditional entropy 
can be determined from the design rate of the residual 
ensemble. 

For transmission over the BEC-WT(e m , e w ), to compute the 
equivocation of Eve H(S_\Z_), we write H(S_,X_\Z_) in two 
different ways using the chain rule and obtain 

H(X\Z) + H(S\X,Z) = H{S\Z) + H(X\S,Z). (41) 

By noting that H{S\X,Z) = and substituting it in (HU), we 
obtain 

H(S\Z) = H(X\Z) _ H(X\S,Z) _ (42) 
n n n 

In the following two subsections we show how the normalized 
averages of H{X\Z) and H{X_\S_, Z_) can be computed. The 
next subsection deals with H{X_\Z_). 

A. Computing the Normalized H(X\Z) 

In the following lemma we show that the average of 
linin^oo H(2£\Z_)/n can be computed by the MMU method. 

Lemma IV. 1. Consider transmission over the BEC- 
WT(e m ,e w ) using the syndrome encoding method with a two 

\Hi] 



H. 



type LDPC code H = 
Hi, and Hi are n(l — 



Ho 



where the dimensions of 



R) x n, n(l — Ri) x n, and 
n(Ri — R) x n respectively. Let S_ be a randomly chosen 
message from Alice for Bob and X_ be the transmitted vector 

which is a randomly chosen solution of HX = ~~ . Let Z_ 

_ 

be the channel observation of the wiretapper Eve. Consider 
a point-to-point communication set-up over BEC(e w ) using 
a standard LDPC code H\. Let X_ be a randomly chosen 
transmitted codeword of the code given by Hi, i.e. X_ is a 
randomly chosen solution of HiX_ — 0. Further let Z_ be the 
channel output. Then 



H (X\Z) = H (X\Z) . 



Proof: We prove the lemma by showing that (X, Z) 
and (X , Z_) have the same joint distribution. Clearly, P(Z_ = 



s 



z\X — x) = P(Z_ = z\X_ = x) as transmission takes place 
over BEC(e,„) in both the cases. Now 

PQL = x) = p (2L = x,S = s) , 

s 

1 i „ 

s 

(b) t{gig=g} 

where (a) follows from the uniform a priori distribution on S_ 
and (b) follows because for a fixed x, 

i {H 2 x=s} = 1. 

Now the a priori distribution of X_ is also the RHS of t43) . 
This is because X_ is a randomly chosen solution of = 0. 
This proves the lemma. ■ 
From Lemma II V. 1 1 we see that when we consider trans- 
mission over the BEC-WT(e m , e w ) using the two edge type 
LDPC ensemble {A, T^ 2 )}, we can compute the average 
of lim„^oo H(X_\Z)/n by applying the MMU method to the 
standard LDPC ensemble {A^, T^- 1 '} for transmission over 
the BEC(e t0 ). We formally state this in the following theorem. 

Theorem IV.2. Consider transmission over the BEC- 
WT( e m , e w ) using a randomly chosen code G from the two 
edge type LDPC ensemble {A, r^^T^} and the coset en- 
coding method. Let X_ be the transmitted word and Z_ be the 
wiretapper's observation. 

Consider a point-to-point communication setup for trans- 
mission over BEC( e w ) using a randomly chosen code G 
from the standard LDPC ensemble {A^^rW}. Let X be a 
randomly chosen transmitted codeword and Z_ be the channel 
output. Let {ft, $} (from the node perspective), be the average 
residual degree distribution^ of the residual ensemble given 
by the peeling decoder and let R^ es be the design rate of the 
average residual ensemble {ft, $}. If almost every element of 
the average residual ensemble {f2, $} has its rate equal to the 
design rate i?^ es , then 



Em m^mi = lim 



E[H d (X\Z) 



(44) 



where x is the fixed point of the density evolution recursion 
for {A^jTW} initialized with erasure probability e w , and 
is the check node degree distribution of Hi from the edge 
perspective. 

Remark: Note that the condition that almost every element 
of the average residual ensemble {fl, $} has its rate equal to 
the design rate can be verified by using [20, Lem. 3.22] or 
lfT31 Lem. 7]. 

2 Q corresponding to the variable node degree distribution, and <I> corre- 
sponding to the check node degree distribution. 



Proof: The first equality in (144-b is the result of Lemma 
HVTI The second equality of © follows from [15 Thm. 10]. 
The factor e^A^ (l — p^\l — x)\ which is the ratio of the 
block length of the average residual ensemble {ft, <£>} to the 
initial ensemble {AW, rW}, takes care of the fact that we 
are normalizing Hq(X\Z) by the block-length of the initial 
ensemble {AW,rW}. ■ 
In the following section we generalize the MMU method 
to two edge type LDPC ensembles in order to compute 
H{X\S,Z). 



B. Computing Normalized H(JC_\S_,Z_) by Generalizing the 
MMU method to the Two Edge Type LDPC Ensembles 



Similarly to Lemma HV. 1 1 in the following lemma we show 
that computing H(X\S, Z) for BEC-WT(e m , e w ) using the 
coset encoding method and two edge type LDPC ensemble 
{A, rW, r^ 2 )} is equivalent to computing the equivocation 
of the same ensemble for point-to-point communication over 
BEC(e w ). 

Lemma IV.3. Consider transmission over the BEC- 
WT(£m, £w) using the syndrome encoding method with a two 

'Pi 



edge type LDPC code H 



Ho 



where the dimensions of 



H, H\, and H2 are n(l — R) x n, n(l — Ri) x n, and 
n(Ri — R) x n respectively. Let S_ be a randomly chosen 
message from Alice for Bob and X_ be the transmitted vector 

which is a randomly chosen solution of HX = ~~ . Let Z 

o 

be the channel observation of the wiretapper Eve. 

Consider a point-to-point communication set-up for trans- 
mission over the BEC( e w ) using a two edge type LDPC code 
j j 

H = TT . Let X_ be the transmitted codeword which is a 

.2. 

randomly chosen solution of HX = and Z_ be the channel 
output. Then 



H(X\S,Z) = H(X\S = Q,Z) = ; H{X\Z). 
Proof: Equality (b) is obvious. To prove equality (a), note 

roi 



(bi 



that for a solution x of Hx 



where Hx' — and Hx„ 



we can write x 



Let z be a specific 

received vector and let z' be the vector that has the same erased 
positions as z and is equal to the corresponding position in x!_ 
in the unerased positions. The proof is completed by noting 
that 



P(2L = x,Z = z\S = s) 



P(X = x!,Z = z!\S = Q). (45) 



Thus from Lemma IIV.3I we see that H(X\S, Z) can be 
computed by generalizing the MMU method to two edge type 
LDPC ensembles. In the next section we accomplish this task. 
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V. MMU Method for Two Edge Type LDPC 
Ensembles 

The peeling decoder described in Step 1 of the MMU 
method and its termination described in Step 2 is the same 
for two edge type LDPC ensembles. The proof of Step 3 of 
the MMU method for two edge type LDPC ensembles is the 
same as that for standard LDPC ensembles. We state it in the 
following two lemmas. 

Lemma V.l. Consider transmission over the BEC(e w ) using 
the two edge type LDPC ensemble {A, I^ 1 ', r*- 2 -*} and de- 
coding using the peeling decoder. Let G be a random residual 
graph. Conditioned on the event that G has degree distribution 
{fl, <&( 2 )}, it is equally likely to be any element of the 
two edge type ensemble {fi, 5>( 2 )}. 

Proof: The proof is the same as for the standard LDPC 
ensemble [22). However, for completeness the proof is given 
in Appendix lAl ■ 

Lemma V.2. Consider transmission over the BEC(e w ) using 
the two edge type LDPC ensemble {A, T^ 1 ', T^ 2 )} and de- 
coding using the peeling decoder. Let {O, $( 2 )} be the 
average residual degree distribution. Let {0(3,$^,$^} be 
the residual degree distribution of a random residual graph 
G. Then, for any 5 > 



{d((n,$w,$«),( 

The distance d(-, •) is the L\ distance 



lim P 

n—too 



))>->} 



o. 



»I»2 



E 

ii 



(1) 



(i) 



E 

32 



(2) 



(2) 



Proof: The proof is very similar to the proof for the 
standard LDPC ensemble given in [20 Thm. 3.106]. We 
provide an outline of the proof in Appendix [B] ■ 
In the following lemma we compute the average residual 
degree distribution of two edge type LDPC ensembles. 

Lemma V.3. Consider transmission over the BEC(e w ) using 
the two edge type LDPC ensemble {A, T^} and de- 
coding using the peeling decoder. Let (xi,X2) be the fixed 
points of (1791) and (|2QI) when initialized with channel erasure 
probability e w . Let yj = 1 — p\ 3 '(l — Xj), j = 1, 2, where p^' 
is the degree distribution of check nodes of type j from the edge 
perspective. Then the average residual degree distribution 
{fJ,$M,$( 2 )} is given by 

tt(zi,z 2 ) = e t0 A(ziyi, Z22/2), 
$0')( z ) = r (i) (l - Xj + XjZ) - XjzT'W{\ - Xj) 

-rW(i- X j), i = i,2, 

where T'w (x) is the derivative of T^> (x). Note that the 
degree distributions are normalized with respect to the number 
of variable ( check) nodes in the original graph. 

Proof: The proof follows by the analysis of the peeling 
decoder for general multi-edge type LDPC ensembles in [23|. 
However, as we are only interested in two edge type LDPC 



ensembles, the proof also follows from the analysis for the 
standard LDPC case ||22). ■ 
Lemma ED E2 and |V3] generalize Step 3 of the MMU 
method for two edge type LDPC ensembles. The key technical 
task in extending Step 4 to two edge type LDPC ensembles 
is to derive a criterion, which when satisfied, guarantees that 
almost every code in the residual ensemble has its rate equal to 
the design rate. The rate is equal to the normalized logarithm 
of the total number of codewords. However, as the average 
of the logarithm of the total number of codewords is hard to 
compute, we compute the normalized logarithm of the average 
of the total number of codewords. By Jensen's inequality this 
is an upper bound on the average rate. More precisely, let N 
be the total number of codewords corresponding to a randomly 
chosen code. Then, by Jensen's inequality 



lim < lim 



log 2 (E(A0) 



If this upper bound is equal to the design rate, then by the 
same arguments as in lfl5l Lem. 7] we can show that almost 
every code in the ensemble has its rate equal to the design 
rate. In the following lemma we derive the average of the total 
number of codewords of a two edge type LDPC ensemble. 

Lemma V.4. Let N be the total number of codewords of a 
randomly chosen code from the two edge type LDPC ensemble 
(A,rW,r( 2 )). Then the average of N over the ensemble is 
given by 

E(N) = 

nAi(l,l),nAi(l,l) ( 

E coef<^ JJ(l + ^ 1 1 4 2 ) nA! i.'2 jlt fi^ 

_E 1= 0,,E2=0 (h,h 

■»A 2 (l,l) r(2) 



oA£(M) r (i) 



^nAyi,!)^ ^Ayi,l)j 



where A}(1, 1) = E JljIa r'«(l) = £ rj r^-lf , j e 

{1, 2}. The polynomial q r {v) is defined as 



q r {v) 



(1 



(1 



(46) 



Proof: Let W(2?i, £2) be the set of assignments of ones 
and zeros to the variable nodes which result in E% (resp. E2) 
type one (resp. type two) edges connected to variable nodes 
assigned value one. Denote the cardinality of W{E\,E%) 
by \W(Ei, £2) |- For an assignment w, let 11 w be a random 
indicator variable which evaluates to one if w is a codeword of 
a randomly chosen code and zero otherwise. Let N(Ei,E 2 ) 
be the number of codewords belonging to the set W(E\, E2). 
Then we have the following relationships 

N(E 1 ,E 2 )= E 1 «> < 47 > 

weW{Ei,E 2 ) 
nAi(l,l),7iA4(X,l) 

N= E N{E X ,E 2 ). (48) 

B 1= 0,_E 2 =0 
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Wl\ follows simply by checking if every word in the set 
W(Ei, E 2 ) is a codeword. We obtain d48b by partitioning 
the set of codewords based on the number of type one and 
type two edges connected to variables assigned value one. By 
linearity of expectation we obtain 



(49) 



E(N(E 1 ,E 2 ))= E (^)> 

w€W(E 1 ,E 2 ) 
nA' 1 (l,l),nA2(14) 

E(N)= E{N{E 1 ,E 2 )). (50) 

From the symmetry of code generation, we observe that 
E(l lu ), for w G W(Ei, E 2 ) is independent of w. Thus we 
can fix w to any one element of W(E\, E 2 ) and obtain 

E(N(E 1 ,E 2 )) = \W(E-l,E 2 )\Pt(w is a codeword) . (51) 

Note that \W(Ei, E 2 )\ is given by 



\W{E 1 ,E 2 )\ =coefl JJ(l + u' 1 1 4 2 )" Ail ' !2 .«f 1 w 



E 2 



(52) 



To understand ( 1521 , note that when a variable node with type 
one degree l\ and type two degree l 2 is assigned a one, it gives 
rise to l\ (resp. l 2 ) type one (resp. type two) edges connected 
to a variable node assigned value one, and when it is assigned 
a zero it gives rise to no such edges. Thus the generating 
function of such a variable node to count the number of edges 
it gives rise to, which are connected to a variable node assigned 
one, is given by 1 + u l ^u l 2 2 . Hence the overall generating 
function is given by Y\ h ^ (1 + u l -{u 2 2 ) nKl i^ ■ 

We now evaluate the probability that an assignment w, w G 
W(Ei, E 2 ), is a codeword, which is given by 



Pr (w is a codeword) = 

Total number of graphs for which w is a codeword 
Total number of graphs 



(53) 



Similar to the arguments for the standard LDPC ensemble in 
[15 1, the total number of graphs for which w is a codeword 
is given by 

Bi!Ba!(TiAi(l, 1) - £i)!(nA 2 (l, 1) - E 2 )\ 

coe M n 1^ r,<i)(i) 1 <^ 2 ) r,(2)(i) 2 ,uf^# 2 \ ■ 

\r!,r 2 ) 

(54) 

The factorial term Ei ! in d54l > corresponds to the fact that given 
a graph for which w is a codeword, we can permute the check 
node side position of the E\ type one edges connected to a 
variable node assigned value one, and w will be a codeword 
for the resulting graph. Similarly, we obtain the other factorial 
terms in (1541 . The generating function in d54T i is the generating 
function to count the number of ways edges can be assigned 
on the check node side such that w is a codeword l20l . 

By noting that the total number of graphs is equal to 
(nAi(l, l))!(nA 2 (l, 1))!, and combining (®, <EQ, (ED, dSS, 



and d54b we obtain the expression for the average of the total 
number of codewords. ■ 
Remark: Note that in Lemma IV.4I we count the number 
of codewords which give rise to E\ type one (resp. E 2 type 
two) edges which are connected to a variable node assigned 
value one. A related quantity is the weight distribution of a 
code which counts the number of codewords with a given 
weight. The average weight distribution of two edge type and 
more generally multi-edge type LDPC ensembles have been 
computed in |24], (25]. 

Let ( ei ,e 2 ) = (E 1 /(nA[(l,l)),E 2 /(nA' 2 (l,l))), i.e. ej is 
Ej normalized by the total number of type j edges, j = 1,2. 
In the following lemma we find the set of (e±,e 2 ) for which 
lin^-voo |W(emAi(l, 1), e 2 nA 2 (l, 1))| ^ 0. 

Lemma V.5. Let £(n) be the set of (ei, e 2 ) such that 
coef j II C 1 + 4 1 4 2 )" Ai1 '' 2 . ^^(1,1)^^(1,1) I 



Let £ = limn-j.oo £{n). Then £ is given by 

£ = {(ei,e 2 ) : 

'52h,h l iAi u i 2 a(h,l 2 ) J2h,i 2 hAi u i 2 a(h,l 2 ) 



(55) 



a; (1,1) 



A 2 (l,l) 



where < l 2 ) < 1. 

Proof: The proof is given in Appendix [C] ■ 
In the next lemma we show that £ as defined in Lemma 
IV.5I is the set enclosed between two piecewise linear curves. 

Lemma V.6. Let £ be as defined in Lemma \V.5\ Then £ is the 
subset of [0, l] 2 enclosed between two piecewise linear curves. 
Order the pairs (l\,l 2 ) for which A/ x j 2 > in decreasing 
order of l\/l 2 and assume that there are D distinct such 
values. Let 



and let 



1 if h/h takes the d th largest possible value, 
otherwise, 

(56) 



Pd = ( a / / 1 , a / / 1 7s )• 



Ai(l,l) 



A' 2 (l,l) 



(57) 



Then £ is the set above the piecewise linear curve connect- 
ing the points {(0,0),pi,pi + p 2 , . . . , (1, 1)} and below the 
piecewise linear curve connecting the points {(0,0), po , Pd + 
Pd-i, •••)(!) 1)}» where addition of points pi+p 2 is the point 
obtained by component wise addition of pi and p 2 . 

Proof: The proof is given in Appendix [D] ■ 
In the following theorem and its corollary, we present a 
criterion for two edge type LDPC ensembles, which, when 
satisfied, guarantees that the actual rate is equal to the design 
rate. In order to state the theorem, we define the function 
0(ei, e 2 ), which is used to calculate the difference between the 
growth rate of the average of the total number of codewords 
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and the design rate. Further, the infimum of ip with respect to ui,u 2 ,vi, and v 2 

is given by solving the following saddle point equations 



0(ei, e 2 ) = J2 A h,h l°g 2 (l + «! 2 4 2 ) - Ai(l, l)ei log 2 m 

Hi) 



— dip dip dip dip 

A , /j ^ oui du 2 dui dv 2 

A 2 (l,l)e 2 log 2 it 2 + p/^i)^ ^ r n )log 2^i^ 1 ) which are equivalent to (f59ll - (l62li. ■ 

We now state the condition, which, when satisfied, guaran- 



A 2 (l, 1) v^t^(2) i / \ tees that the actual rate is equal to the design rate. 



Ai(l, l)ei log 2 V! + r ^ lo §2 1r 2 !> 2 ) 



Corollary V.8. Le? 9(e\,e 2 ) foe as defined in ( f5&l ). 



-A 2 (l,l)e 2 log 2U2 -A' 1 (l,l)/i( ei )-A 2 (l,l)/i( e2 )-i? des , // sup, eifea)6£ 0(ei,e 2 ) - i.e. */ 0(1/2, 1/2) > 

(58) ^(ei, e 2 ), V(ei, e 2 ) G £, f/zen for any 5 > 

where ux, u 2 , t>i, and u 2 are positive solutions to the following lim P (Rq > R^ es + 5) = 0. 

equations 

"i \V T ,(i) (l+^i) ri ' 1 -(l-^i) ri - ] 



77ie sef £ is defined in Lemma \V.5\ 

lY^^2 r ^ ) {1 l^'^y, + ( 1 _^jr 1 =ei ' (59) P/oq/: From Theorem E3 E[JV] = 2 n ^+°( 1 )). Now 

from Markov's inequality, 



rW(i) E ^ ^^t+C^ + Si-^" 1 = e2 ' (60) p (i?G * **■ + s) = p(n> 2«c*^^)) 

. , «i «a (61) < 2 , 



li.ia 1 2 where (a) follows from Markov's inequality. This proves the 

l i u l 2 corollary. 



A x (l,lj^ l + u 1 1 u 2 2 

1 ^ _ coronary. ■ 

j^i ^ pj A; li / 2 i 2 - — u i t ^i 2 — e 2- (62) Note that in general for a two edge type LDPC ensemble 

2 ' h,h 12 in order to check if the actual rate is equal to the design rate, 

Theorem V.7. Consider the two edge type LDPC ensemble we need to compute the maximum of a two variable function 

(A, rW,r( 2 )) with design rate i?des- Let N be the total over the set E. However, the set £ is just a line for two edge 

number of codewords of a randomly chosen code G from this type left regular LDPC ensembles. Thus we deal with the case 

ensemble and let Rq be the actual rate of the code G. Then of left regular LDPC ensembles in the following lemma. 

log 2 (E[./V]) _ \ i tj Lemma V.9. Consider the left regular two edge type LDPC 

11IYL — o Up (7^0X7 ^2 / 1 -'•'des ; r 1 1\ ~i 

n-s-oo n (ei,ea)e£ ensemble {h, £ 2 , T 1 - >, r 1 - >} with design rate i?des- Let N be 



, n , \ • j £ j • /Toi 7 1 . c . , j, , . the total number of codewords of a randomly chosen code G 
where 9(ei,e 2 ) is defined in ( Dal ) and the set t is defined in j j j 

Lemma FK5] from this ensemble and Rq be its actual rate. Then 



Proof: By (gOj, we have Jirn^ log2 ^ N ^ = sup Q{e) + i? de 

lim l0g2(E[jV]) = //su Pe6(0>1) f3(< ) i.e. if m f>) : »U ).V<- € (0. I i. then 



n->oo n e£(0,l) 

» = i.e. if 9{ 

for any 6 > 



log 2 (E[^( ei nA;(l,l), e2 nA 2 (l,l))]) 

, SU P^ ™ n ' lim P i R G > Rd es + 6)=0 

Using Stirling's approximation for the binomial coefficients The function 9(e) is defined as 

and ll26l Theorem 2] for the coefficient growths in Lemma , 

23 we know that ~ 9(e) = (1 - h - h)h(e) + ^y-- log^x) 



, jm log 2 (E[^( ei nA;(l,l),e 2 nA 2 (l,l))]) = 



n— >oc 



n + p(2)/Q'v E r ^ 2) log 9r (^2 ) - e/i log ui - eZ 2 log w 2 - R des , 

sup inf >Q ^(ei, e 2 , ui, u 2 , «i, u 2 ) (63) ^ ' r 

(ei,e 2 )e£ 11 2 ' !' 2 where vi (resp. V2) is the unique positive solution of $59$ (resp. 

where ip(ei, e 2 , ui, u 2 , v\, w 2 ) is given by H60j ) with e\ (resp. e 2 j substituted by e on the RHS. 

V A h . i2 log 2 (l + u^w, 2 ) - Ai(l, l)ei log 2 ux Proo -f : Most of the argument 8 in this lemma are the same 

— ' ' ' as those of TheoremlV.7l so we will omit them. First note that 



u 1 



A' 2 (l, l)e 2 log 2 u 2 + rW log 2 q ri (vi) is given by 



the cardinality of the set W(Ex , E 2 ), as defined in Lemma [V4l 



I W(Ex , E 2 ) I = coef { ( 1 + u[ l u l 2 2 ) n , uf 1 wf 2 } 



-Ai^Dexlog.^ + ^l^rWlog,^^) 

V ' r 2 = < ' 2 !l 

A 2 (l,l)e 2 log 2U2 -A , 1 (l,l)/ l (e 1 )-A 2 (l,l)/i(e 2 ). (64) IU/J otherwise 
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Let e = Ei /(nli) = Ei/inl^). By Stirling's approximation 
and the saddle point approximation for the coefficient terms 
pp. 517], we obtain 



lim 

n— ¥00 



where 



log 2 (E[A] 



log 2 (E[7V(en/i,en/ 2 )]) 



lim sup 

n ^°°eG(0,l) n 

sup inf xp(e, vi, V2), 



ip{e,vi,v 2 ) =(1 -h- h)h(e) 
I 



YiWT\) ^ r ^ log2 9ri ^ ~ dl log2 



t'l 



h 



— T^ 2) log 2 q r (v 2 ) - el 2 log 2 v 2 . 



rw(i)^ 

The saddle point equations are obtained by taking the partial 
derivatives of ip with respect toVj,j £ {1,2} and setting them 
equal to 0. These equations are the same as (|59l l (resp. (l60l l) 
with ei (resp. e 2 ) substituted by e on the RHS. ■ 

Remark: Note that as in iflSl . we can change the order of inf 
and sup. Taking the derivatives after changing the order gives 
a function which is an upper bound on 6(e). The advantage of 
this upper bound is that it can be computed without solving any 
saddle point equations. However as opposed to the standard 
LDPC ensembles, for two edge type LDPC ensembles this 
upper bound is not tight and does not provide a meaningful 
criterion to check if the rate is equal to the design rate. 

The following two lemmas show that in the case of a left 
regular ensemble where rw and T^ 2 > both have only either 
odd or even degrees, the function 9(e) attains its maximum 
inside the interval [0, 1/2]. 

Lemma V.10. Consider the left regular two edge type LDPC 
ensemble {li, l 2 , T^}. Let 9(e) be the function as de- 
fined in Lemma [V9[ If both rW and are such that both the 
type of check nodes only have odd degrees, then for e > 1/2 

9(e) < 9(1/2). 

Proof: The proof is given in Appendix [E] ■ 

Lemma V.ll. Consider the left regular two edge type LDPC 
ensemble {li, l 2 , T^, T^ 2 )}. Let 9(e) be the function as de- 
fined in Lemma \V9\ If both T^- 1 ' and are such that both 
the type of check nodes only have even degrees, then for 
ee (0,1/2) 

9(e) = 9(1 -e). 

Proof: The proof is given in Appendix |F| ■ 
In the following theorem we state how we can compute the 
quantity H(X\S, Z) appearing in (l42l . 

Theorem V.12. Consider transmission over the BEC- 
WT( e m , e w ) using a random code G from the two edge 
type LDPC ensemble {A, T^} and the coset encoding 
method. Let S_ be the information word from Alice for Bob, X_ 
be the transmitted word, and Z_ be the wiretapper's observa- 
tion. 

Also consider a point-to-point communication setup for 
transmission over the BEC( e w ) using the two edge type 



LDPC ensemble {A, rW, T^} Assume that the erasure prob- 
ability e w is above the BP threshold of the ensemble. Let 
{Q, $( 2 )} be the average residual ensemble resulting 
from the peeling decoder. Let i?^ es be the design rate of the 
residual ensemble {fl $ (2) }. If {tt, $M ; $( 2 )} satisfies 
the condition of Theorem \V. 71 i.e. if the design rate of the 
residual ensemble is equal to the rate then 

%H G (X\S,Z)) 



lim ■ 

n— ¥00 



e w A(yi,y 2 )R r d 



(66) 



where xi,x 2l yi, and y 2 are the fixed points of the density 
evolution equations §19\ and (1201) obtained when initializing 
them with = x% = e w . 

Proof: From Lemma HV.3I we know that the conditional 
entropy in the point-to-point set-up is identical to H(X\S. Z). 
The conditional entropy in the point-to-point case is equal to 
the RHS of d66i l. This follows from the same arguments as in 
ifBl Thm. 10]. The quantity e w A(yi,y 2 ) on the RHS of ^ 
is the ratio of the number of variable nodes in the residual 
ensemble to that in the initial ensemble. ■ 
This gives us the following method to calculate the equivo- 
cation of Eve when using two edge type LDPC ensembles for 
the BEC-WT(e r „, e w ) based on the coset encoding method. 

1) If the threshold of the two edge type LDPC ensemble is 
lower than e w , calculate the residual degree distribution 
for the two edge type LDPC ensemble for transmission 
over the BEC{e w ). Check that the rate of this residual 
ensemble is equal to the design rate using Theorem 
rV?7l Calculate H(X\S,Z) using Theorem |VT2] If the 
threshold is higher than e w , Et(2£_\S_,Z_) is trivially zero. 

2) If the threshold of the standard LDPC ensemble induced 
by type one edges is higher than e w , calculate the resid- 
ual degree distribution of this ensemble for transmission 
over the BEC(e tu ). Check that its rate is equal to the 
design rate using lfl5l Lemma 7]. Calculate H(X\Z) 
using Theorem IIV.2I If the threshold is higher than e w , 
H(X\Z) is trivially zero. 

3) Finally calculate H(S\Z) using d42l . 

In the next section we demonstrate this procedure by comput- 
ing the equivocation of Eve for various two edge type LDPC 
ensembles. 

VI. Examples 

Example 1. Consider using the ensemble defined by Standard 
LDPC degree distribution Q] defined in Section [TTTJ for trans- 
mission over the BEC-WT(0.5, 0.6) at rate R ab = 0.498836 
b.p.c.u. (the full rate of the ensemble), without using the coset 
encoding scheme. Here every possible message s corresponds 
to a single codeword x, and encoding and decoding is done 
as with a standard LDPC code. Since the threshold is 0.5, 
Bob can decode with error probability approaching zero. 
The equivocation of Eve is given by H(S_\Z_) = H(X\Z) 
which can be calculated using the MMU method. In Fig- 
ure H we plot the function 'I'.rsiu).*^)}^) defined in ifTBI 
Lemma 7] corresponding to the standard LDPC ensemble 
which is the average residual degree distribution 
of the ensemble induced by type one edges for transmission 
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Fig. 4. *;n(i) for Example [T] and |2 

over the BEC(e w ). From |[T5l Lemma 7], if the maximum 
of ^jq(i) $<i)}(m) over the unit interval occurs at u = 1, 
which holds in this case, the design rate of the residual graph 
is equal to the actual rate. Thus we can calculate the aver- 
age equivocation lim. T ,._>.nn H (X \Z)/n = 0.0989137 b.p.c.u. 
Using this ensemble we can achieve the point (R a i,,R e ) = 
(0.498836,0.0989137) in the rate-equivocation region which 
is very close to the point C = (0.5,0.1) in Figure |2] 

Example 2. Now consider the two edge type ensemble defined 
by Two Edge Type Degree Distribution Q] defined in Section 
UTTl for transmission over the BEC-WT(0.5, 0.6) using the 
coset encoding scheme. Again Bob can decode since the 
threshold of the ensemble induced by type one edges is 0.5. 
Since the threshold of the two edge type ensemble is 0.6 
we get H(X\S,Z) = 0, and we get H(S\Z) = H(X\Z). 
The degree distribution of the type one edges is the same 
as the degree distribution in Example 1, so we again get 
lim JWOC E(#(X|Z))/n = 0.0989137. Using this scheme we 
achieve the point (R ab ,R e ) = (0.0999064,0.0989137) in the 
rate-equivocation region which is very close to point B = 
(0.1,0.1) in Figure |2 

Example 3. Consider transmission over the BEC- 
WT(0.429, 0.75) using the coset encoding scheme and 
the regular two edge type ensemble defined by 

Two Edge Type Degree Distribution 3. 

A(x,y)=x 3 y 3 (67) 
T {1) (x) = x & (68) 
r (2) (x) = x 12 . (69) 

The design rate of this ensemble is 0.25 and the threshold is 
0.469746. The threshold for the ensemble induced by type one 
edges is 0.4294, so it can be used for reliable communication 
if e m < 0.4294. 

To calculate the equivocation of Eve, we first calculate 
]im n ^. 00 H{X}Z)/n by the MMU method. We calculate the 
average residual degree distribution {S^ 1 ', of the en- 

semble induced by type one edges for erasure probability 
e w and plot ^{nt 1 ),^ 1 )}^) m Figure [5] As in Examples 1 
and 2, we see that it takes its maximum at u = 1. Thus, 
by IfTSI Lemma 7], we obtain that the conditional entropy is 
equal to the design rate of the residual ensemble normalized 
with respect to the number of variable nodes in the original 
ensemble, i.e. rim n _ J . 00 E(H(X\Z))/n = 0.250124 b.p.c.u. 




Fig. 5. 9(e) and $ (i) } («) for ExamplefJ] 



We now calculate the average residual degree distribution 
(fl, $( 2 )) of the two edge type ensemble corresponding 
to erasure probability e w and plot the function 9(e) defined in 
Lemma lY9l If 9(e) is less than or equal to zero for e 6 [0, 1], 
then the rate of the residual ensemble is equal to the design 
rate by Lemma |V91 Then we can calculate H(X\S_,Z) using 
Lemma [V. 121 In Figure |5]we see that sup ee j ,i 9(e) = 0, and 
we get lim JWOC E(i7(X|S;,Z))/n = 0.000124297 b.p.c.u. 

Finally, using (gS) we get E(H(S\Z))/n = 0.24999998. 
We thus achieve the point (R a b,Re) = (0.25,0.24999998) in 
the rate-equivocation region. We see that we are very close to 
perfect secrecy. The reason that we are so far away from the 
secrecy capacity C s — 0.321 is that the (3, 6) ensemble for 
the main channel is far from being capacity achieving. 

Example 4. Consider the two edge type ensemble 

Two Edge Type Degree Distribution 4. 

A(x,y) =0.5572098xV + 0.1651436a;V 

+ 0.07567923xV + 0.0571348xV 
+ .043603xV + 0.02679802a;V 
+ O.OmSSSlS^V 3 + 0.0294308a; 1 V 
+ 0.02225301x 3 V + 0.00886105a; 10 V, 

r (1) (a;) = 0.25a; 9 + 0.75x 10 , 
T^Oc) = x 12 

where the graph induced by type one edges has the same 
degree distribution as Standard LDPC Degree Distribution Q] 
and the graph induced by type two edges is (3, 12) regular. 
The rate of the overall ensemble is 0.248836 and the rate from 
Alice to Bob is R a b = 0.25 b.p.c.u. Consider transmission over 
the BEC-WT(0.5, 0.751164). 

In Figure|6] we plot ^{n* 1 ) *< 1 )}( u ) f° r tne residual ensem- 
ble {f^ 1 ), fl^ 1 )} induced by type one edges for transmission 
over the BEC(e tu ). Since the maximum of ^(0(1)^(1) }(u) over 
the unit interval occurs at u = 1 we obtain by lfT5l Lemma 
7] that the rate is equal to the design rate for this residual 
ensemble. In Figure [6] we plot 9(e,\,e>}) for the residual 
ensemble (fi, $W, $( 2 )) of the two edge type LDPC ensemble 
for transmission over the BEC(e„,). Since the maximum of 
&2) over the unit square is zero, we obtain by Theorem 
IV.7I that the rate is equal to the design rate for this residual 
two edge type ensemble. In this case we can calculate the 
equivocation of Eve and find it to be 0.24999999 b.p.c.u., 
which is very close to the rate. Thus this ensemble achieves 
the point (R,R e ) = (0.25,0.24999999) in the capacity- 
equivocation region in Figure |2] Note that the secrecy capacity 
is 0.251164 b.p.c.u. 



14 




Fig. 6. 6»(ei,e 2 ) and */ n (i) jS (i)i(") for Example 4. 



These examples demonstrate that simple ensembles have 
very good secrecy performance when the weak notion of 
secrecy is considered. 

VII. Conclusion 

We consider the use of two edge type LDPC codes for the 
binary erasure wiretap channel. The reliability performance 
can be easily measured using density evolution recursion. We 
generalize the method of lfl31 to two edge type LDPC codes 
in order to measure the security performance. We find that rel- 
ative simple ensembles have very good secrecy performance. 
We have constructed a capacity achieving sequence of two 
edge type LDPC ensembles for the BEC based on capacity 
achieving sequences for the standard LDPC ensemble. How- 
ever, this construction introduces some degree one variable 
nodes in the ensemble for the main channel, requiring an era- 
sure free main channel. We use linear programming methods to 
find ensembles that operate close to secrecy capacity. However, 
as the underlying channel in our setup is a BEC, it is highly 
desirable to construct explicit sequences of secrecy capacity 
achieving ensembles. Due to the two dimensional recursion 
of density evolution for two edge type LDPC ensembles this 
is a much harder problem. In our opinion, this is one of the 
fundamental open problems in the setting of using sparse graph 
codes for transmission over the BEC-WT(e m , e w ). 
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Appendix A 
Proof of Lemma IvTI 

Proof: Consider a residual graph G. Consider two type 
one edges e\ and (the argument is the same for type two 
edges). Swap the check node side end points of ei and e2- We 
denote the resulting graph by G' . The proof is completed by 
noting that the number of erasure patterns which result in G 
are equal to the number of number of erasure patterns which 
result in G' . This is because if the variable nodes in G form 
the largest stopping set in the erasure pattern then so do the 
variable nodes in G' . ■ 
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Appendix B 
Proof Outline of Lemma |yT2l 



Proof: The proof for the standard LDPC case uses the 
Wormald technique described in [20 App. C]. Our proof is 
the same as that for the standard LDPC case except that we 
have to keep track of the degree distribution of two different 
types of edges. 

Assume that in the peeling decoder a degree one check node 
is chosen randomly from the set of degree one check nodes. 
Let Git) be the residual graph after the t iteration of the 
peeling decoder. Let V^j 2 (t) (resp. (t)) be the number of 
type one (resp. type 2) edges which are connected to a variable 
node of degree (h,i 2 ) in G(t). For j G {1,2}, let V^(t) be 
the vector of number of type j edges of different degrees i.e. 
V^(t) = {V$ 2 (t)} iui2 . Let Cf>(t) (resp. cf (i)) be the 
number of type one (resp. type two) edges which are connected 
to type one (resp. type two) check nodes of degree i at time t. 
For j 6 {1, 2}, let C«(t) = {c\ 3) {t)} % . To show the concen- 
tration of the residual degree distribution using the Wormald 
technique, we note that {V^ (t),V^ {t),C^ {t),C^ (t)) is 
a Markov process. The next requirement is that the maximum 
possible change in V0 2 (i) and c\ j \t) for j e {1,2}, for 
all (11,12) and for all i after an iteration of the peeling 
decoder should be bounded. This is true as all the degrees 
are finite. The functions which describe the expected change 
in V^l (t) and C t - (t) are also Lipschitz continuous in 
(V^\t)/n,V^(t)/n,C^(t)/n,C^(t)/n), where n is the 
number of variable nodes. For example, as long as C-i (t) + 
Cf } (t)>0, for je{l,2} 



v^{t+i) v^ 2 it)\y (1) ^y (2) (t\c (i \t\c^{t) 



rU) 



i-V {j) 

h v ni 2 



'1'2 



The RHS of the previous equation is the same as that for 
the standard LDPC ensemble which has been shown to be 
Lipschitz continuous. 

The last required condition is that of initial concentration, 
i.e. the concentration condition should be satisfied at the 
beginning of the peeling decoder. This proof is the same as 
that for the standard LDPC ensemble given in [20 App. C]. 



Appendix C 
Proof of Lemma [v31 

Proof: The terms in the expansion of Yli i (1 + 

Wi 1 ^ 2 )"^ 1 '' 2 have the form 

Ei,,i 2 lik{h,l 2 )A, , E| ll!2 (2fe('l.'2)Ai 1 ,l 2 

u 1 u 2 1 2 , 

where < ia) < n - If the coefficient of 

u e 1 nA 1 (i,i) u e2nA 2 (i,i) non _ zer0) mere exist {k{h 1 l2)}i 1 ,i 2 
such that 

YjhkQuh^iuh = emAi(l,l) 



and 

hk{h,l2)Ai uh = e 2 nA 2 (l, 1) 
which is the same as 

(ei ' e2j - 1 ' mJ) j ' 

where < a(h,l2) — k{li : l2)/n < 1. When n grows this is 
the same as (|55T >. ■ 

Appendix D 
Proof of Lemma [\T61 
Proof: We show that £ is the set between the two 
piecewise linear curves described in the statement of this 
lemma. We show this by varying the a(h, l 2 ) between and 
1 while trying to make the ratio e\/e<z as large as possible. 
Start by letting <r(Zi , Z2) = if I1/I2 is not maximal, and 
letting (7(^1,^2) increase to 1 if I1/I2 is maximal. This traces 
out the line between (0, 0) and p%, and clearly we can not 
have (ex, 62) below this line for {e\,e-i) £ £■ Then increase 
&(h, h) for l\, I2 such that I1/I2 takes the second largest value. 
This traces out the line between p\ and p% + p 2 and again 
it is clear that we can not have (ex, €2) below this line for 
(ei, e 2 ) £ £ . We continue like this until we have er(/i, h) = 1 
for all l\, I2, which corresponds to the point (1, 1). The upper 
curve is obtained by reversing the order and starting with the 
line between (0,0) and po- ■ 

Appendix E 
Proof of Lemma [vTTol 

Proof: Take the derivative of 9(e) with respect to e to get 
^ =(1 - h- h) log f~~~~J ~ h \°g v i ~ h\ogv 2 
= log - hlof 



({I- e)v 2 



h log 



Using d59l ) and d60T ) we obtain 



1 vi y „ r (i) (i+fi) ri ' 1 -(i-fi)'' 1 - 1 
1 — e x r <i)' (!) Z^n ' 1 1 r i (i+i>i) r i+(i-t)i) r i 



l)' (1) Z^ri I 1 n (l+i>i)''i+(l-i'i)''i 

f-»i) T,1 ~ 1 -(i-«i)' 
(l+i;i) r i+(l-t)i) T 

y r ,r (1) ::. (l+^i)'' 1 - 1 -(l-"i) ri " 1 

V r r (l) (l+^i) rl - 1 +(l-^i) rl ~ 1 
' i A n (i+t>i) r i+(i-Di)''i 

y " r (i),. 



r< 



V r,r (1) fl m ( 1 +"i) ri " 1 -( 1 -«i) ri ~ 1 



or 



(l-e)ui _ E ri r i r 



(1) (i+^i) r -i- 1 +(i-«i) r i" 1 

r l (H-Ul)'-l+(l-!)l) r l 



ri (l + «l) r l+(l-«l) r l 



(70) 



We obtain a similar expression for (1 — e)v2/e. Note that 
^j(e) are increasing functions of e and Wj(l/2) = 1, Thus for 
e > 1/2, > 1 which together with ( T70b implies 



> 1 



when all r are odd. This in turn implies that # < for 
e > 1/2. ■ 
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Appendix F 
Proof of Lemma [yTTI 

Proof: First we show that v(l — e) = l/v(e) if there are 
only even degrees. Let Vj(e) = v and 1/v = v. Then 

1/g , } ( 1 + i/gjr-l -(1-1/^-1 

rw(i)^ r + + 

(1 + -D) 7 "- 1 + (1 - -D) 7 "- 1 



rO')'(l)^ ' (l + ij)r + (l_ S )r 

and 

i- e= i— r ^E^ )(i r )r : 1 "i i ~T 

ro)'(i)^ r (i + v y + (i - vy 



ro)'(i)^ r V (i + «r + (i-t/r 

= 1 v rrw (i + ^ + q-^r 1 
rW(i)^ r (i + < + (i - v) 1 - 

These two equations imply that w(l — e) = l/i>(e). Now note 
that 

QrO-M = — - 

for r even, so 

9(1 - e) = (1 - h - l 2 )h(l - e) + ^ J2 ^ ^ 

+ TW(T) ? bg ^ " (1 " e)/l bg(lM) 

-(l-e)Z 2 l0g(l/u 2 ) - i?de S 
= (1 - h - l 2 )h(l -e) + ^ lo g<?>l) 

- h log Vl + Ti 2y^ T r 2) l0 § It M - h log V 2 

+ (1 - e)h log(ui) + (1 - e)Z 2 log(u 2 ) - i? des 
= %), 
using that 

; V r, W) log < = ; V rrW) log Wj = /, log 
rO)'(i) ^ ' J rw (i) ^ J 

in the second equality. ■ 



